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ABSTRACT 



The effects of three variables on the difficulty of 
verbal arithmetic problems were examined. Variables included problem 
form, sequence of information, and problem verb, A total of 32 
problems was generated, tour in each of four problem forms and two 
sequences of information* Vocabulary words were not above 
second-grade level, and numbers used ranged from 2 through 9 with no 
borrowing or carrying required. Two groups of elementary-grade 
subjects (63 in all) solved all of the problems,, Analysis of variance 
performed on the data indicated that problem form, sequence of 
information, and their interaction were significant (pC.001) tut that 
the problem verb was not. Reverse sequence problems were most 
difficult to solve and became more difficult as the problem form 
became more difficult. It was concluded that subjects need to 
distinguish sequence of information from sequence of events where 
these do not coincide and that reverse sequence causes the greatest 
difficulty in problem solving. Tables and references are included, 
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THE SEQUENCE OF INFORMATION IN ARITHMETIC WORN PROBLEMS 1 
Daniel J. A. Rosenthal and Lauren B. Resnick 
University of Pittsburgh 

This experiment was designed to examine the effects 
of 3 variables on the difficulty of verbal problems in 
arithmetic. These variables included (a) the form of the 
problem, (b) the sequience of problem information, and 
(c) the problem verb. The meaning of each of these variables 
will be discussed below. 

Four different problem forms were defined. These 
word problem forms can be conceptualized as semantic 
elaborations of forms for number problems defined by 
Suppes, Hyman, and Jemian (1966) for the numbers m, n, 
and p. The problem forms appear in Table 1. The 4 
number problem forms and the 4 word problem forms can be 
differentiated on the basis of which set is unknown, and 
whether the indicated operation is addition or subtraction. 

In the word problem forms, the grammatical subject always 
starts out with the m set, gains or loses the n set 
(depending on the indicated operation in the related 
number problem form), and ends up with the p set. The 
underlined elements in the problem forms in column 2 were 
variable elements, and were replaced by appropriate words 
from predefined lists. In this way, a set of word 
problems were generated from each problem form. A 
£0 sample of the word problems that were generated appears; 
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in the last column of the table. 

The second experimental variable was related to 
the sequence in which information about events is presented. 
The semantic information about a sequence of events can 
be presented in the order in which the events themselves 
occur, or in some other order. The word problems in 
Table 1 contain a forward sequence of information. For 
example, in the first sample item in column 3, Paul 
started out with 5 boats, and that information is given 
first. In Table 2, the general forms are transformed into 
a backward or reverse seqiience. The problems that were 
generated from these forms have the information aboiit 
events stated in the reverse order from which the events 
themselves occur. For example, in the first sample item 
in column 3 > note that Paul started out with 5 boats as 
he did in the corresponding item in Table 1, but that that 
information is given last. 

The third variable was the problem verb, which 
signified an additive situation in problem forms 1 and 3, 
and a subtractive situation in forms 2 and 4. Four 
addition verbs and 4 subtraction verbs were used. Each 
verb was used once in each relevant problem type. 

Meaningful comparisons can be made between the effects of 
the 4 additive verbs and also between the effects of the 
4 subtractive verbs. 



METHOD 

In order to carry out the experiment, 32 word 
problems were generated, 4 in each of the 4 problem forms 
and 2 sequences of information. Two groups of subjects 
(63 in all) solved all 52 problems. Vocabulary words were 
at the second grade level at most. The numbers used 
ranged from 2 through 9 with no borrowing or carrying 
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needed. The problems were presented in written form. 

The subjects read each problem aloud and the experimenter 
gave an assist if a subject had difficulty reading a 
word. 



RESULTS 

The results of an overall analysis of variance on 
the collected data appear in Table 3, and indicate that 
the form of the problem, the sequence of problem information, 
and their interaction were highly significant'. Secondary 
analyses indicate that the problem verb was not significant. 
Some of these statistics are reported in greater detail in 
Tables 4, 5» and 6, and in Figure 1. The form totals on 
the bottom line of Table 4 show that subjects made many 
more errors in forms 3 and 4 where the unknown set was the 
starting set than in forms 1 and 2 where the unknown set 
was the final or ending set. These totals also show 
differences ill the level of difficulty of problems in each 
form. The sequence total column shows that problems in 
the reverse sequence were more difficult to solve. In 
addition to these main effects there was a significant 
interaction: the effect of the reverse sequence of information 
was heightened as the problem form became more difficult 
(see Figure 1 ) . Problems in form 1 were quite easy for 
most subjects and the differential effects of information 
sequence were minimal here. Tables 5 and 6 show mean errors 
for the additive verbs and the subtractive verbs respectively. 
There are no significant differences to report. 




3 



4 



DISCUSSION 

The problem form results support the notion that 
subjects begin to solve problems by using the information 
in the starting set. This strategy is adequate in problem 
forms 1 and 2 (based on m+n=?) where information about the 
starting or m set is given, but not in forms 3 and 4 
(based on ?+n=p) where information about the starting set 
is not given, and where subjects made many more errors. 

The information sequence results support the hypothesis 
that subjects need to distinguish the sequence of information 
from the sequence of events when the 2 sequences do not 
coincide. In the problems with a forward sequence of 
information events are mentioned in their proper temporal 
order, whereas in the problems with a backward sequence of 
information events are not mentioned in their proper 
temporal order, and it is in the latter type that subjects 
made significantly more errors. These results are in 
keeping with the finding of Clark and Clark (1963) that 
complex sentences are easier to recall when the order of 
mention of events directly indicates the temporal order. 
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Table 3» Overall analysis of variance; 

2 groups x 4 problem forms x 2 information 
sequences 



Main effects 
Groups (G) 


df 


MS 


E 








Hypothesis 


1 


1.9012 


2.3776 


Error 


61 


.7996 




Problem Eorm (A) 








Hypothesis 


3 


35.3353 


8'.' 5028 


Error 

Information Sequence ( 


183 

:b) 


4.1557 




Hypothesis 


i 


7.6270 


46.5447 


Error 


61 


.1639 




Interactions 

AxB 






6.2933* 


Hypothesis 


3 


1.1693 


Error 


183 


.1858 




GxA 








Hypothesis 


3 


.3565 


.0857 


Error 


183 


4.1557 




GxB 








Hypothesis 


1 


.0023 


.0142 


Error 


61 


.1639 




GxAxB 








Hypothesis 


3 


.3713 


1 . 9983 


Error 


183 


.1858 





* p<.001 
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Table 4. Mean errors according to problem form 
and information sequence. Ss solved 4 problems 
in each cell. E=63. 





Form 1 


Form 2 


Form 3 


Form 4 


Sequence Total 




Mean 


S.D. 


r r ean 


S • D • 


Mean 


S.D. 


Mean- 


S.D. 


Mean, 


S o.D ^ 


i Forward 


.41 


. 66 


o'46 


V88 


1F.22 


1.53 


1.49 


1.49 


4'. 59 


2.92 


Reverse 


• 46 


.76 


.79 


1.02 


3,16 


1.27 


2.14 


1.47 


6.55 


2.66 


Form Total 


'.87 


1.17 


1.25 


1.54 


5.38 


2.39 


3.63 


2.65 







Figure 1. Tie an errors according to problem form 
and information sequence. 3s solved 4 problems 
at each data point. IT=53» Problem forms ore 
arranged in sequential order of difficulty. 
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Table 5. Mean errors in addition' problem forms (1 & 3). 
Ss solved 4 problems in each cell. 17=63. 




Reverse Sequence 
Forward Sequence 



Verb, , 




Bought 


Found 


Toole 


Got 


Mean 

S.D. 


1.65 

.79 


1.48 

c88 


1.68 

.93 


1.44 

.88 



Table 6£ Mean errors in subtraction problem forms (2 & 4). 
Ss solved 4 problems in each cell. 11=63. 
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Verb 




Sold 


lost 


Gave 


Sent 


Mean 
S .Do 


1v25 

tS7 


1.17 

.87 


1.17 

r.oo 


1.29 

.97 
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